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(54)'nae: OBJECT RECOGNmON METHOD 
(57) Abstract 

A method to identify tbt location and orientation of an article is provided, the method comprising the steps of: obtaining an image 
of the article with the article having a known orientation and location relative to a camera; creating a X and Y template edge matrix from 
the image of the article; creating a plurality of sets of modified template edge matrices, each of the sets of modified template edge matrices 
being an X and Y template edge matrix with the article in a different orientation; capturing a digital visual image containing the article, the 
digital image being a matrix of pixels; creating X and Y article edge matrices from the matrix of pixels; quantifying difference between 
each of the sets of modified template edge matrices and the X and Y article edge matrices with the modified template edge matrices placed 
at a plurality of locations within the bounds of the article edge matrices; and identifying the location and orientation of the article as the 
orientation of the article represented by the set of modified template edge matrices at the location within the bounds of the X and Y article 
edge matrices with the minimal quantified differences between the modified template edge matrices and the X and Y article edge matrices. 



FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCT on the front pages of pamphlets publishing intemationa] . 
applications tinder the PCT. 



AM 


Aimcnia 


GB 


United Kingdom 


MW 


Malawi 


AT 


Amaia 


GE 


Georgia 


MX 


Mexico 


AU 


Australia 


GN 


Gninea 


NE 


Niger 


BB 


Baibados 


GR 


Greece 


NL 


Netherlands 


BE 


Belgium 


HU 


Hungary 


NO 


Norway 


BF 


Burfcina Faso 


IE 


Ireland 


NZ 


' New Zealand 


BG 


Bulgaria 


IT 


Italy 


PL 


Poland 


BJ 


Benin 


JP 


Jflpan 


PT 


Portugal 


BR 


Brazil 


KE 


Kenya 


RO 


Romania 


BV 


Belarus 


KG 


Kyrgystan 


RU 


Russian Federation 


CA 


Canada 


KP 


Democratic People's Republic 


SD 


Sudan 


CF 


Central African Rqwblic 




of Korea 


SE 


Sweden 


CG 


Congo 


KR 


Republic of Korea 


SG 


Singapore 


CH 


Switzerland 


KZ 


Kazakhstan 


SI 


Slovenia 


a 


C6tc d*Ivoire 


U 


' Itfiocfatcnstcm 


SK 


Slovakia 


CM 


Cameroon 


LK 


SriLanki 


SN 


Senegal 


CN 


China 


LR 


Liberia 


sz 


Swaziland 


CS 


Czechoslovakia 


LT 


Lithuania 


TD 


Chad 


CZ 


Czech Republic 


LU 


Luxembourg 


TC 


Togo 


DE 


Gennaoy 


LV 


Latvia 


TJ 


Tajikistan 


DK 


Denmark 


MC 


Monaco 


TT 


Trinidad and Tobago 


EE 


Estonia 


MD 


Republic of Moldova 


UA 


Uknune 


ES 


Spain 


MG 


Madagas^ 


UG 


Uganda 


Ft 


Finland 


ML 


Mali 


US 


United States of America 


FR 


France 


MN 


Mongolia 


uz 


Uzbekistan 


GA 


Gabon 


MR 


Mauritania 


VN 


Vict Nam 



wo 96/39678 PCT/US96/07859 

DESCRIPTION 
VISUAL RECOGNITION METHOD 

Technical Field 

This invention relates to a method for identifying the 
location and orientation of a known article within a visual 
field. 

Background Art 

U.S. Pat. No. 5,379,353 suggests a differential 
analysis circuit that utilizes a step to identify edge 
vectors for identification of such things as a road for a 
mobile robot. A digital image captured from a video ceunera 
is processed using an algorithm that includes generation of 
a differential of brightness along each row of pixels, and 
presumably also along each column of pixels. The absolute 
value of the differential brightness represents a change in 
the picture, and a differential that exceeds a threshold is 
identified as a possible edge to a road. 

U.S. Pat. No. 5,381,155 suggests a speed detection 
system that identifies moving vehicles in the view of a 
fixed camera, measures the speed at which the vehicles are 
moving, and identifies a license plate number from the 
vehicle. Commercially available systems are disclosed that 
are said to be capable of identifying the license plate 
within a captured image and then reads the numbers and 
letters within the license plate number. 

U.S. Pat. No. 5,381,489 suggests a system for 
recognition of characters on a meditun. This system includes 
making a window of a possible character from the meditim, and 
then comparing that window to each template within a set. 
The entire set of templates must be screened each time a 
character is identified. The templates are generated based 
on previously recognized characters from the document where 
the initial recognition rec[uires a more rigorous comparison 
to different character features. 

A problem faced in visual recognition is to recognize 
the location, within the view of a camera, and the 
orientation, of a particular article where the article may 
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be one of a relatively few possible articles already 
identified from a library of potential articles. The 
possibility of a variety of lighting conditions and shadows 
me^ce such recognition difficult. There are also typically 
5 constraints on the amount of computer data storage available 
at the site of a desired visual recognition facility. 
Therefore, templates of different orientations an scales of 
the different articles can generally not be generated and 
stored initially. 

10 Such a problem in visual recognition is encountered 

when visual recognition is used as a means to identify 
vehicles or determine the orientation of vehicles in an 
automated refuelling system. For example, in U.S. Pat. No. 
3,527,268 it is suggested that vehicle identification in an 

15 automated refuelling system can be achieved in a fully 
automated method by a photo-electric means to detect the 
silhouette of the automobile. How this is to be done is not 
suggested. 

It is therefore an object of the present invention to 

20 provide a method to identifying the location and orientation 
of an article, wherein the method is capable of identifying 
the location and orientation of the article in a variety of 
natural and artificial lighting conditions, and wherein a 
large number of templates do not have to be digitally 

25 stored. 

Disclosure of the Invention 

These and other objects of the invention are 
accomplished by a method to identify the location and 
orientation of an article, the method comprising the steps 

30 of: obtaining an image of the article with the article 
having a known orientation and location relative to a 
camera; creating a X and Y template edge matrix from the 
image of the article; creating a plurality of sets of 
modified template edge matrices, each of the sets of 

35 modified template edge matrices being a X and Y template 
edge matrix with the article in a different orientation; 
capturing an digital visual image containing the article. 



2 
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the digital image being a matrix of pixels; creating X and 
Y article edge matrices from the matrix of pixels; 
quantifying difference between each of the sets of modified 
template edge matrices and the X and Y article edge matrices 
5 with the modified template edge matrices placed at a 
plurality of locations within the bounds of the article edge 
matrices; and identifying the location and orientation of 
the article as the orientation of the article represented 
by the set of modified template edge matrices at the 
10 location within the bounds of the X and Y article edge 
matrices with the minimal quantified differences between the 
modified template edge matrices and the X and Y article edge 
matrices. 

This method can be readily adapted to identification 

15 of a location and orientation of a vehicle within a bay for 
automated refuelling purposes. The make and model of the 
vehicle can be identified by another means, such as for 
example, driver manual input, a magnetic or optical strip, 
or a passive or active transponder located on the vehicle. 

20 With the make and model identified, or limited to one of a 
small number of possibilities (such as when more than one 
transponder signal is being received) , base templates can 
be retrieved from storage . The base templates can be 
prepared from a digital visual image of the known make and 

25 model of vehicle with the vehicle positioned at a known 
location with respect to the camera, and the image processed 
by generation of X and Y edge matrices. After the make and 
model of the vehicle are identified, a series of modified 
templates are created from the retrieved templates by 

30 rotation of the template edge matrices to different angles 
from the initial orientation and/or scaling the matrices to 
represent different distances from the csuaera. Thus, only 
one set of base templates (or one set of X and Y edge matrix 
templates) needs to be stored in the data base for each 

35 vehicle. A captured visual image containing the vehicle 
within the refuelling facility can then be processed to 
generate article edge matrices, and compared to the modified 
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templates, with each modified template being compared to the 
article edge matrices at different locations within the 
article edge matrices* 

Preferably, a mask of the template is prepared so that 
5 only the outlines and/or internal edges of the article, and 
not the surrounding area, is compared to the actual article 
edge matrices. The mask also provides expected dimensions 
of the article so that only locations within the article 
edge matrices within which the article would fit would be 

10 searched for the article, and the article can be identified 
with a position relatively close to the edge of the view. 

Separately comparing the X and Y edge template matrices 
with the article X and Y edge matrices significantly 
improves the robustness of the method , and results in 

15 reliable fits being found quickly in a variety of light 
conditions, with partial obstruction of the view of the 
article, and with partial masking by dirt, leaves, grass, 
and other articles that may be present in a relatively 
uncontrolled environment. 

20 Detailed Description of the Invention 

A camera is typically used in the practice of the 
present invention to capture a visual image of an article 
in a known position and orientation. A digital image can 
be captvired using one of the commercially available 

25 framegrabber hardware and associated software packages. The 
digital image is a matrix of pixels, each of the pixejLs 
having a number that corresponds linearly to a brightness. 
A color image can be utilized, in which case the image is 
represented by three matrices, one each for red, green and 

30 blue. Typically, the images of about 256 by 240 pixels are 
preferred for the practice of the present invention because 
such a nxamber of pixels results in sufficient resolution and 
is within the capacity of relatively inexpensive video 
cameras. The video camera may generate an image of about 

35 twice the resolution of a 256 by 240 matrix, in which case 
the image can be reduced by averaging adjacent pixels to 
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create a matrix of pixels having one half the height and one 
half the width by averaging blocks of four pixels. 

Signal to noise ratios can be increased by averaging 
two or more consecutive images. 

Edge matrices may be generated from both the images 
containing the article in a known location and orientation 
relative to the camera, and the images containing the 
article within which the location and orientation of the 
articles are to be determined, by applying operators such 
as the following: 



12 1 
0 0 0 
-1 -2 -1 



and; 



1 0 -1 

2 0-2 
10-1 



As can be seen from these operators, they each result 
in a matrix in which the elements will sum to zero. The 
absolute values of the elements of the resulting matrices 

15 indicate the change in brightness along the x and y axis 
respectively. The use of edge magnitudes helps make the 
appearance invariant to direction of light and color of the 
object. Producing these edge matrices therefore results in 
images that can be compared with templates inspite of 

20 significant differences in lighting or color of the article 
(although color could be identified as well in the practice 
of the present invention) • The results of these two 
operators can be summed to obtain one edge vector matrix, 
but in the practice of the present invention, it is 

25 significant that the two are not coiabined for comparison. 
Not combining the two greatly increases the robustness of 
the algorithm, i.e. the ability of the algorithm to identify 
outlines when the articles are masked with dirt, partially 
obscured, or subjected to varying light conditions. 
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A mask is preferably place over the ixaage of the edge 
matrices of the article with the know location and 
orientation so that only the know outlines of the article 
are considered. The masked regions can be referred to as 
5 "don't care" regions, because edge data in these regions 
will be ignored when fitting the edge matrices of the 
article in the known position to the edge matrices of the 
article within which the location and orientation of the 
article is to be identified. 

10 The dimensions of the mask can also define limits of 

the locations within the image containing the article that 
could contain an image of the article. For example, if the 
mask were fifty pixels by fifty pixels within an image of 
256 pixels by 240 pixels, then only locations within the 

15 middle 206 by 190 pixels could be the center of the mask, 
if the entire article is within the image. 

When a color image is used, edge matrices are 
preferably generated for each color, and then the three edge 
matrices are preferably combined to form one X or Y edge 

20 matrix. This combination can be by sximming the absolute 
values of the three edge matrices (and dividing the sum by 
three) , by selecting the maximum value of the edge matrix 
among the three, by calculating an average, or by taking the 
square root of the sum of the squares of corresponding 

25 elements of the edge matrices. It may also be possible to 
consider two of the three colors in, for example, one of the 
preceding ways. The use of a color image improves the fit 
to a template by providing that more edge information is 
extracted from an image. For example, an edge image at an 

30 interface between colors can be identified even if the 
interface is between surfaces having similar brightness. 
Use of color images increases the cost of the camera, and 
the increases amount of data processing recpiired to take 
advantage of having three sets of images, but is preferred 

35 if the difficulty of the application warrants the additional 
expense. 
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The image of the article may be reduced by, for example 
averaging adjacent pixels. An image is therefore created 
that contains fewer pixels for comparison of the modified 
templates to the article edge matrices for finding an 
5 initial position and orientation estimate. For example, a 
matrix of 256 by 240 pixels could be reduced to a matrix of 
64 by 60 pixels by two successive averaging and subsampling 
operations. Comparisons of the reduced matrices can be 
accomplished much more quickly, and then the fit of the 
10 reduced matrices can be used as a starting point for finding 
a fit for the larger matrices. Generally, only locations 
within a few (one to three) pixels of the pixels averaged 
into the best fit result of the reduced matrix need to be 
compared at higher levels of resolution, 
15 Reducing the matrices can significantly reduce 

computing time required to compare the template edge 
matrices with the article edge matrices. Two reductions, 
each being two for one linear reductions, are recommended. 
Thus, each reduction therefore reduces the amount of 
20 information to be considered by a factor of four. The 
combined reductions reduce the amount of information by a 
factor of sixteen. Further, each of the parameters for 
which templates are prepared are of lower resolution, 
resulting in fewer sets of rotated templates, and at fewer 
25 locations within the view of the article edge matrix. 
Initial searches within the reduced matrixes can therefore 
be performed in two or three orders of magnitude less time 
than if the article edge matrix was searched at the original 
level. 

30 When the article which the image is to be searched for 

is know, a template of that article, preferably as two edge 
matrices with a mask, can be selected from a data base. The 
template can then be modified to represent the article in 
a plurality of orientations. By orientations, it is meant 

35 that the two dimensional image of the article is rotated 
about the axis of the view of the camera, rotated to an 
angled view of the object, and/ or scaled to represent 
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changes in distance from the camera. Increments of, for 
excunple, two to three degrees of rotation can be used to 
obtain a sufficient number of orientations that one should 
have a clearly best fit for the article in an particular 
5 orientation. 

For an application such as an overhead camera 
identifying a vehicle's position within a bay of an 
automated refuelling system, an expected orientation can be 
predicted (most drivers drive in relatively straight) > and 

10 it can be also predicted that the actual orientation will 
not be more than a certain variation (for example, plus or 
minus twenty degrees) from the expected orientation. Thus, 
only a limited number of modified template edge matrices 
need to be crejated. But creating these modified templates 

15 after the vehicle make and model have been identified 
considerably reduces the amount of computer storage needed 
to store template matrices. 

Rotation of the template matrices about an axis 
essentially normal to a plane of the two dimensional view 

20 of the video ceunera (or "transforming" the image to the new 
orientation) is readily accomplished by well known methods. 
Such transformations are preferably performed by calculating 
the point within the original matrix of pixels each pixel 
within the transformed matrix would lie so that the four 

25 pixels of the original matrix surrounding the center of the 
pixel from the transf oraed matrix can be used to interpolate 
a value for the pixel of the transformed matrix. Again, 
methods to accomplish these interpolations are well known. 
The templates could also be created with the image 

30 scaled to represent the article located at different 
distances from the camera. This scaling is accomplished by 
changing the dimensions from a center point of the camera 
view inversely proportional with the distance from the 
camera. This scaling is preferably performed based on 

35 distances from an effective pinhole, where the effective 
pinhole is defined as a point through which a perspective 
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projection is made by the camera. This effective pinhole 
would therefore be slightly behind the lens of the ceunera. 

A more difficult problem is to identify a location and 
orientation of a known article or outline when viewed at an 
5 angle significantly different from normal to a plane 
containing the article or outline. For example, a camera 
located on a refuelling apparatus may need to locate a 
gasoline nozzle cover lid from an position that does not 
allow viewing of the cover lid with the camera facing 

10 perpendicular to the plane of the cover lid. A rectangular 
lid cover would therefore not appear to the camera to be 
rectangular. The distortion from a rectangular shape would 
depend upon both the angle and the relative position of the 
lid with respect to the centerline of the camera's view 

15 (known as the optical axis) • 

Geometric distortion can be eliminated from images that 
are not normal to the optical axis if the article of the 
image can be approximated by a planar image. If the angle 
of the optical axis from perpendicular of the planar image 

20 of the article is known (i.e., the image to be searched for 
the article) , geometric distortion can be removed, and 
images obtained that represent a transformation to 
perpendicular views of the article in the image to be 
searched. Likewise, if the templates are created wherein 

25 the optical axis is not perpendicular to the plane of the 
template, geometric distortion can be removed from the 
templates by such a transformation. If the angle from 
normal to the optical axis is not known for the image to be 
searched, this angle can be another search parauneter. 

30 Such transformation to a perpendicular view is 

simplified by the fact that the transformation is the same 
for a given angle between the optical axis and the normal 
of the plane approximately containing the article, 
regardless of the displacement between the caunera and the 

35 plane, provided that the target remains in the limits of the 
view of the camera. 
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The preferred transformation method in the practice of 
the present invention, rather than to place a pixel from an 
article image matrix within a transformed image, will take 
a pixel location from the transformed matrix and calculate 
5 the location of that pixel within the article image matrix. 
An interpolation is then performed using four pixel values 
of the article image matrix surrounding the position of the 
inversely transformed matrix pixel to determine the value 
of the pixel in the transformed image. The following 
10 equations provide the location of a pixel from the 
transformed image on the article image, for the case of the 
article plane normal being perpendicular to the image X 
axis : 



and: 




15 where: 

a=sin(e) (5) 

and: 

2?=cos(e) (6) 

and: is the ratio of actual article image plane x 
position to Pq, 

py is the ratio of actual article image plane y 
20 position to Pq, 

Po is the perpendicular distance from the effective 
pinhole to the actual article, 
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Pq' is the distance from the plane of the transformed 

image to the effective pinhole, 

P„ is the vertical displacement of the camera of the 

transformed image relative to the camera position in the 

actual image, 

ay is the y coordinate value in the transformed image, 
a, is the w coordinate value in the transformed image, 

and 

9 is the downward pitch angle of the plane normal to 
the camera* 

For 9 of up to about fifty degrees, the following 
ratios can be used to fit a good portion of the original 
image into the transformed image: 



and 



where pyj is half of the vertical height of the original 
image. 

Although modified templates can be created with 
rotations and changes in distances from the camera, a 
plurality of such rotations and changes could result in an 
exceedingly large niimber of modified templates. It is 
therefore preferred that searches are carried out over one 
variable out of the possible rotating, scaling, and angled 
views in the practice of the present invention. 

If the orientation of the article with respect to 
rotation within a plane perpendicular to the camera view is 
expected to be within about twenty degrees of the 
orientation of the article having the known orientation, the 
template X and Y edge images may be simply individually 
rotated to form the modified edge template images prior to 
comparing the modified template edge images to the article 
edge images. When more than about twenty degrees of 
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rotation is possible, a new set of edge images is preferably 
created based on a combination of the original edge images. 
The X and the Y edge image values together represent an edge 
vector having an angle (arctan(Y/X) ) and a magnitude 
( (X^+Y^)^'2) . This angle may be rotated by the angle of 
rotation of the template and new X and Y components 
calculated. Typically, only the absolute values of the X 
and Y components are stored, and therefore edge vectors in 
the first or third quadrant must be differentiated from edge 
vectors of the second or fourth quadrant. Edge vectors in 
the third and fourth quadrants could be considered as their 
negative vectors in the first and second quadrants 
respectively, and therefore just two quadrants of vectors 
need be identified. Quadrants of edge vectors can be 
identified with a single additional binary template 
generated from the original template image, the binary 
template having pixels representing whether the edge 
magnitude vector at that point represents an edge whose 
direction vector is in the first or third quadrant, or the 
second or fourth quadrant. This template can be 
automatically generated from the template image. This 
requires very little additional storage space, and can be 
used during a rotation operation to adjust the X and Y edge 
magnitude weights to their exact proper proportion at very 
little extra computational cost. Rotation of the edge 
matrices by any amount of rotation can thereby be made 
completely valid. 

The following equation is convenient for the purpose 
of quantifying the differences between the modified template 
edge matrices and the article edge matrices because 
commercially available image processing cards are available 
to quickly generate the comparisons: 
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pU,y) 



(9) 



Where X is a X template edge matrix of i by j pixels rotated 
to an orientation to be tested against a portion of the 
image matrix, 

Y is a y template edge matrix of i by j pixels rotated 
5 to an orientation to be tested against a portion of the 
image matrix, 

X' is a portion of an image X edge matrix of i by j 
pixels located at a position of coordinates x,y on the X 
image edge vector matrix, 
10 y' is a portion of an image Y edge matrix of i by j 

pixels located at a position of coordinates x,y on the Y 
image edge vector matrix, and 

p(x,y) is a grey scale edge correlation normalized for 
point (x,y). 

15 The grey scale edge correlation will be a number 

between zero and one, with one being a perfect match. Grey 
scale correlations are performed for each x and y within the 
article edge matrix for which the entire modified template 
edge matrix can fit within the article edge matrix. The 

20 resulting grey scale correlation that is the closest to 
approach unity is the closest fit. Interpolation between 
veiriables can be achieved using linear or squared weighing 
above a noise threshold. Such variables may be, for 
example, angle of rotation, or x and y locations. 

25 Portions of the calculations to generate these grey 

scale edge matrices can be quickly made using a GPB-1 
atixiliary card-AlignCard. 

"Don't care" regions may also fall within the 
boundaries of the i by j dimensioned matrices of the 

30 modified template edge matrix. Pixels in the template 
identified as "don't care" are preferably not used in the 
summations of the terms of Equation 9. 
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Because the grey scale edge matrix correlation result 
is very sensitive to relative displacement of an object *s 



performed prior to comparison of the two. Although reducing 
the matrices as described above has a smoothing effect, a 
further smoothing operation may also be included. This 
smoothing operation may be performed on each before the 
correlation is calculated, but after the subsampling to a 
current search level. A preferred smoothing operation is 
a Gaussian approximation, given by the following convolution 
kernel : 



When this smoothing is applied, it is preferably applied to 
both the article edge matrix and the modified template edge 
matrix. 

A preferred application of the method of the present 
invention is an automated refuelling methods disclosed in 
U.S. Pat. Appl. Nos. 461,280 (Docket No. TH0622) , 461,281 
(Docket No. TH0572) , and 461,276 (Docket No. TH0573, the 
disclosures of which are incorporated herein by reference. 

The embodiments described above are exemplary, and 
reference is made to the following claims to determine the 
scope of the present invention. 



template and test image, a smoothing operation may be 
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CLAIMS 

1. A method to identify the location and orientation of 
an article, the method comprising the steps of: 

obtaining an image of the article with the article 
5 having a known orientation and location relative to a 
camera; 

creating a X and Y template edge matrix from the image 
of the article; 

creating a plurality of sets of modified template edge 
10 matrices, each of the sets of modified template edge 
matrices being a X and Y template edge matrix with the 
article in a different orientation; 

capturing an digital visual image containing the 
article, the digital image being a matrix of pixels; 
15 creating X and Y article edge matrices from the matrix 

of pixels; 

quantifying difference between each of the sets of 
modified template edge matrices and the X and Y article edge 
matrices with the modified template edge matrices placed at 

20 a plurality of locations within the bounds of the article 
edge matrices; and 

identifying the location and orientation of the article 
as the orientation of the article represented by the set of 
modified template edge matrices at the location within the 

25 bounds of the X emd Y article edge matrices with the minimal 
quantified differences between the modified template edge 
matrices and the X and Y article edge matrices. 

2. The method of Claim 1 further comprising the steps of 
smoothing the modified template edge matrices and the 

30 article edge matrices by averaging adjacent pixels and 
subsampling to obtain reduced matrices with a reduced number 
of pixels; 

quantifying the difference between each of the reduced 
modified template edge matrices and the reduced article edge 
35 matrices with the modified template edge matrices placed at 
a plurality of locations within the bounds of the article 
edge matrices; and 
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quantifying the difference between each of the sets of 
modified template edge matrices and the X and Y article edge 
matrices with the modified template edge matrices placed at 
a plurality of locations within the bounds of the article 
edge matrices only for locations near the location and the 
orientation having minimum differences between the rieduced 
matrices. 

3. The method of Claim 1 wherein the edge matrices are 
obtained by applying to the image to obtain horizontal and 
vertical edge matrices respectively the operators: 

'12 1' 

0 0 0 
.-1 "2 -1 

and; 

1 0 -l' 

2 0-2 

1 0-1 

4. The method of Claim 1 wherein a pliurality of modified 
template edge matrices are created with the template edge 
matrix scaled to represent different distances from the 
camera • 

5. The method of Claim 1 wherein a plurality of modified 
template edge matrices are created with the template edge 
matrix tramsf ormed to represent different angles from normjal 
to the optical axis. 

6. The method of Claim 1 wherein portions of the template 
edge matrices outside of outlines of the article are ignored 
when quantifying the difference between each of the modified 
template edge matrices and the article edge matrices. 

7 . The method of Claim 1 wherein the plurality of 
locations is every contiguous set of pixels within the 
article edge matrices within which a modified template edge 
matrices will fit. 

8. The method of Claim 2 wherein the plurality of 
locations for which the difference between each of the 



1 
8 



1 
8 
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reduced modified template edge matrices and the reduced 
article edge matrices are quantified include every 
contiguous set of pixels within the reduced modified 
template edge matrices will fit. 

9. The method of Claim 1 wherein a color image is 
obtained, and single color edge matrices are created for 
more than one color, and then combined to obtain the 
template edge matrices. 

10. The method of Claim 9 wherein three set of single color 
edge matrices are created. 

11. The method of Claim 2 wherein edge matrices are 
obtained by applying to the image to dbtain vertical and 
horizontal edge matrices respectively the operators: 



12 1 
0 0 0 
-1 -2 -1 



and; 



10-1 
2 0-2 
10-1 



15 12 . The method of Claim 11 wherein portions of the template 
edge matrices outside of outlines of the article are ignored 
when quantifying the difference between each of the modified 
template edge matrices and the article edge matrices. 

13. The method of Claim 12 wherein the plurality of 
20 locations comprises every contiguous set of , pixels within 

the matrix of pixels within which a modified template edge 
matrices will fit. 

14. The method of Claim 12 wherein the plurality of 
locations for which the difference between each of the 

25 reduced modified template edge matrices and the reduced 
article edge matrices are quantified comprise every 
contiguous set of pixels within the reduced modified 
template edge matrices will fit. 
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15 . The method of Claim 14 wherein a color image is 
obtained, and single color edge matrices are created for 
more than one color, and then combined to obtain the 
template edge matrix. 
5 16. The method of Claim 15 wherein three sets of single 
color edge matrices are created and then combined to obtain 
the template edge matrix. 

17. A method to identify the location and orientation of 
an article, the method comprising the steps of: 
10 obtaining an image of the article with the article 

having a known orientation and location and distance from 
a camera; 

creating a X and Y template edge matrix from the image 
of the article; 

15 creating a plurality of sets of modified template edge 

matrices, each of the sets of modified template edge 
matrices being a X and Y template edge vector matrix with 
the article in a different orientation; 

capturing an digital visual image containing the 
20 article, the digital image being a matrix of pixels; 

creating X and Y article edge matrices from the matrix 
of pixels; 

smoothing the modified template edge matrices and the 
article edge matrices by averaging adjacent pixels and 
25 subsampling to obtain reduced matrices with a reduced number 
of pixels; 

quantifying the difference between each of the reduced 
modified template edge matrices and the reduced article edge 
matrices with the reduced modified template edge matrices 

30 placed at a plurality of locations within the bounds of the 
article edge matrices; and 

quantifying the difference between each of the sets of 
modified template edge matrices and the article matrices 
with the modified template edge matrices placed at a 

35 plurality of locations within the bounds of the article edge 
matrices only for locations near the location and the 
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orientation having minimuia differences between the reduced 
matrices; and 

identifying the location and orientation of the article 
as the orientation of the article represented by the set of 
modified template edge matrices at the location within the 
bounds of the X and Y article edge matrices with the minimal 
quemtified differences between the modified template edge 
matrices and the X and Y article edge matrices, 

wherein portions of the template edge matrices outside 
of outlines of the article are ignored when quantifying the 
difference between each of the modified template edge 
matrices and the article edge matrices. 

18. The method of Claim 17 wherein the plurality of 
locations for which the difference between each of the 
reduced modified template edge matrices and the reduced 
article edge matrices are quantified include every 
contiguous set of pixels within the reduced modified 
template edge matrices will fit. 
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Abstract 

PROBLEM TO BE SOLVED: To prevent a disaster from 
occurring due to an error in oil feed operation in 
self-service feeding. 

SOLUTION: The vehicle fuel supply system includes an ID 
device mounted on a vehicle for use and an ID reader 2 

and an oil feed controller 3 which are placed in a gas 
station for use. ID information indicating a type of used 
fuel of 

the vehicle is transmitted using radio waves, and the ID 
information is received on a gas station sid.e, wherein if 
the 

type of the fuel used by the vehicle obtained from the 
received ID information coincides with a type of fuel a 

customer intends to feed, oil feeding is permitted, and a 
warning is given otherwise. Thus since only fuel coinciding 

with the used- fuel of the vehicle can be fed, even an 
ama:teur may not erroneously feed another type of fuel, 
thereby 

ensuring safe oil feeding. 



